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ABSTRACT 

This theoretical work defines the measure of autocorrelation 
of evolvabthty in the context of neutral fitness landscape. 
This measure has been studied on the classical MAX-SAT 
problem. This work highlight a new characteristic of neu- 
tral fitness landscapes which allows to design new adapted 
metaheuristic. 

Categories and Subject Descriptors 

1.2.8 [Problem Solving, Control Methods, and Search]: 

Heuristic methods — fitness landscapes, neutrality, measures 

General Terms 

Theory 

Introduction 

Fitness landscape, introduce by Wright [4] in evolutionary 
biology, is one of the powerful metaphor to model evolu- 
tionary process. The dominant view in this metaphor is an 
adaptive evolution where an uphill walk of a population on 
a mountainous fitness landscape in which it can get stuck on 
suboptimal peaks. In combinatorial optimization, this view 
also influence the design of metaheuristic: the geometry of 
multimodality or ruggedness describes the fitness landscape 
and the metaheuristics try to escape from local optima by 
using a probability to explore the landscape in simulated an- 
nealing, by using a memory in tabu search, or by preserving 
the diversity of population in evolutionary algorithm. 

Another geometry of fitness landscapes, enlightened in 
molecular evolution by Kimura takes an important place 
in optimization: the neutral fitness landscape. In the the- 
ory of neutral evolution, the overwhelming majority of mu- 
tations are either effectively neutral or lethal and in the 
latter case purged by negative selection. According to this 
theory, fitness landscapes are dominated by plateaus, called 
neutral networks. The landscapes from genetic program- 
ming or from applicative problems such as minimal linear 
arrangement are known to be neutral. It is difficult to de- 
cide whether neutrality is useful for optimization. This work 
propose to deeper describe neutral fitness landscapes in or- 
der to get some characteristics of theses problems and obtain 
a more complete view on neutrality which allows to design 
more useful metaheuristic. 



1. FITNESS LANDSCAPES 

We will use the definition of fitness landscapes from 2]- 
A fitness landscape is a triplet (5,V,/) such as: 5 is the 
set of potential solutions, V : iS ^ 2'^ is the neighborhood 
function which associated to each solution s € iS a set of 
neighbor solutions V(s) C S, and / : 5 — > IR is the fitness 
function which associates a real number to each solution. 

1.1 Rugged Fitness landscapes 

Weinberger ,6 introduced the autocorrelation function 
and the correlation length of random walks to measure the 
ruggedness of fitness landscapes. 

Given a random walk (st, st+i, . . .), the autocorrelation func- 
tion p of a fitness function / is the autocorrelation function 
of time series {f{st), /(st+i), . . .) : 



p(fc) 



E[f{st)f{s,+,)]-E[f{st)]E[f{st+,)] 
var{f{st)) 



where E[f{st)] and var{f(st)) are the expected value and 
the variance of /(st). The correlation length r = — jpg^p^-,-, , 
measures how the autocorrelation function decreases and it 
summarizes the ruggedness of the landscape: the larger the 
correlation length, the smoother is the landscape. 

1.2 Neutral fitness landscapes 

The geometry of neutral fitness landscapes are based on 
the concept of neutral neighborhood and neutral networks. 

For every s € S, the neutral neighborhood of s is the set 
V„eut(s) = {s G V(s) I f{s) = f{s )} and the neutral de- 
gree of s is the number of neutral neighbors of s. There 
is no exact definition of neutral fitness landscape but we 
can define a fitness landscape as neutral if there are "many" 
solutions with "high" neutral degree. In this case, we can 
imagine fitness landscapes with some plateaus called neu- 
tral networks. There is no significant difference of fitness 
between solutions on neutral networks and the population 
drifts around on them. 

The Neutral Networks (NN) of a fitness landscape are 
connected graphs which are the connected components of 
graph {S,Vneut). Solutions in a NN have the same fitness 
value and there is a path of neutral neighbors between two 
solutions of a NN. The presence of NN takes place in the 
search dynamic. For example, the time of drift on NN during 
the search process depends on the properties of the networks. 
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2. THE AUTOCORRELATION OF 
EVOLVABILITY 

Evolvability is defined by Altenberg [l] as "the ability of 
random variations to sometimes produce improvement" . As 
enlighten by Turney [S] the concept of evolvability is difficult 
to define. As he puts it: "if s and s' are equally fit, s is more 
evolvable than s' if the fittest offspring of s is more likely 
to be fitter than the fittest offspring of s'". Following this 
idea the evolvability of a solution is defined by a function ef 
that assigns to every s £ S a real number which measure the 
evolvability. For examples, the evolvability function could 
be the maximum fitness from the neighborhood e/(s) — 
max{f{s) I s e V(s)}. 

We define the autocorrelation of evolvability for a neutral 
network A'^ as the autocorrelation function of evolvability on 
neutral networks. 

The autocorrelation of evolvability on the neutral network 
A'^ is the autocorrelation of series {ef{so), e/(si), . . .) 
where (sq, si, . . .) is a neutral random walk on N. 

A neutral random walk is a series of solutions (so, si, . . .) 
such as Si+i £ V(sj) and /(si+i) = /(s,)- To extend this 
measure to the set of all neutral networks, the average of au- 
tocorrelation coefficient is computed. Several choices could 
be made to define evolvability function; in particular we 
call autocorrelation of maximal evolvability the autocorrela- 
tion when the evolvability is the maximum fitness from the 
neighborhood of a solution. 

The evolvability gives the fitnesses of neutral network in 
the neighborhood. For example, the maximum evolvability 
of a solution is the fitness of the higher NN in the neighbor- 
hood. The autocorrelation of evolvability allows to describe 
the distribution of neutral networks around. If the corre- 
lation is large, the fitness in the neighborhood of a NN is 
distributed regularly, whereas if the correlation is low, the 
NNs around a NN is randomly distributed. 

3. FIRST RESULTS ON THE MAX-K-SAT 
PROBLEM 

In the following we present the first measures of autocor- 
relation of evolvability. The MAX-k-SAT is defined from 
the SAT optimization problem. SAT is a decision problem 
that asks whether a binary tuple can be found that satisfies 
all clauses in normal conjunctive form. Many studies deal 
with the solution space of the SAT problem such phase 
transistion arround the threshold Oc defined as the ratio be- 
tween the number of clauses and the number of variables. 
For k — 3, ac is equal to 4.3. 

The experiments are led in the same way as for preview 
landscapes with random instances of MAX-3-SAT. The num- 
ber of variables is set to = 16 and N = 64, the number 
of literals by clause is fe = 3 and the number of clauses m 
describe respectively the sets {39, 59, 64, 69, 74, 79, 99} and 
{200, 250, 265, 275, 285, 300, 350}. The average neutral de- 
gree decreases when m increases. 

The figure [1] shows the correlation length of maximal evol- 
vability. For all the parameters, the correlation is significant. 
The correlation length is around 2 for A = 16 and around 5 
for N = 64. For all the value of the number of clauses, the 
autocorrelation functions are nearby and the variations of 
correlation length are weak according to the parameter a. 
The correlation decreases slowly according to the number of 
clauses, which is linked to the neutrality. The autocorrela- 



tion of maximal evolvability do not shows a phase transition 
around the threshold Oc = 4.3. The neutral networks are 
not randomly distributed in the fitness landscapes. Those 
first experiments show that the autocorrelation of evolvabil- 
ity is one of characteristic of applicative neutral fitness land- 
scapes. 
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Figure 1: Correlation length of maximal evolvability 
for A = 16 and 64 and different number of clauses. 



4. CONCLUSION 

From the metaphor of neutral fitness landscapes, the neu- 
tral networks (NN) are the plateaus. For each NN, we have 
defined the autocorrelation function of evolvability. The first 
studies on applicative MAX-SAT problem has showed a new 
characteristic of those problem which can be compared to 
the preview additive landscapes. 

The autocorrelation of evolvability is an useful measure 
which highlight a new characteristic of neutral fitness land- 
scapes which could be study in real optimization problems. 
In spite of a lack of diff'erential between fitness in a NN, 
evolvability could be exploit to guide the search process on 
a network. Futures works could take into account this in- 
formation to design new metaheuristics adapted to neutral 
fitness landscapes. 
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